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Executive Summary 



This report marks the first comprehensive analysis conducted by the National Center on Edu- 
cational Outcomes (NCEO) of trends in the public reporting of state assessment results for 
students with disabilities. This study followed four analyses of public reporting conducted by 
NCEO since the passage of the federal No Child Left Behind Act of 2001 (NCLB). Greater 
numbers of states than ever before are reporting assessment data for students with disabilities 
disaggregated by grade level and content area. At the same time, states have made improve- 
ments in their data collection systems that make this type of reporting possible. Unfortunately, 
the number of states for which data were available across the four years was relatively small. 
For the regular assessment, only slightly over half had performance data across this time period, 
and fewer than ten states had participation data for each of the four years studied. Even with a 
more lenient approach to looking at alternate assessment data (i.e., including a state if it had at 
least three years of data), only eight states reported performance data for the alternate assess- 
ment across the time period, and no states reported participation data in a consistent manner 
across each of the four years. 

Based on the states with data across years, average percentages of students with disabilities 
performing at the proficient or above level showed moderate increases across the four years 
for both reading and math in elementary and middle schools. Performance data for high school 
students did not show the same gains. Trend data also showed lower percentages of high school 
and middle school students demonstrating proficient or above performance, as compared to 
elementary school students. This tendency was true for both reading and math. Continued 
investigations of not only trend data but also the data available for examining trends is an im- 
portant step for evaluations of the changes in participation and performance of students with 
disabilities over time. 
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Overview 



States have been required to publicly report on the participation and performance of students with 
disabilities in large-scale assessments since the 1994 reauthorization of the federal Elementary 
and Secondary Education Act (ESEA), called the Improving America’s Schools Act (IASA). 
The reauthorization of the Individuals with Disabilities Education Act (IDEA) in 1997 initiated 
an alignment with ESEA, and specified that each state had to report assessment data for children 
with disabilities “with the same frequency and in the same detail as it reports on the assessment 
of nondisabled children” (IDEA, 1997). States were required to report the number of children 
with disabilities participating in regular assessments and in alternate assessments. Reporting 
on the performance of these children was required beginning in 1998 for regular assessments, 
and in 2000 for alternate assessments, if numbers would permit statistically sound inferences 
and not result in individually identifiable information (IDEA, 1997). 

In 2001, the No Child Left Behind Act (NCLB) Title I provisions expanded the testing and ac- 
countability requirements that had been in place from IASA. Under IASA requirements, each 
state (or district) receiving Title I funding had to administer student assessments in mathematics 
and reading/language arts once in each grade band of 3-5, 6-9, and 10-12. NCLB required that 
starting no later than 2005-06, states had to have in place assessments in reading and math for 
each of grades 3-8, and at least once in grades 10-12; and by 2007-08, measure science at least 
once in each of the grade-level bands of 3-5, 6-9, and 10-12 (NCLB, 2001). 

The Individuals with Disabilities Education Improvement Act of 2004 (IDEA 2004) reinforced 
the reporting provisions of the 1997 IDEA amendments and systematically aligned these require- 
ments with the mandates of NCLB. IDEA 2004 and NCLB set strict requirements for public 
reporting of participation and performance for students with disabilities in statewide assessments, 
including assessments with appropriate accommodations and alternate assessments. First, these 
laws required public reporting of participation of all students, as well as disaggregated reporting 
of several key subgroups, including students with disabilities. Second, NCLB established criteria 
for states’ definitions of Adequate Yearly Progress (AYP) used for accountability purposes and 
required that disaggregated performance results be made public through state/district annual 
report cards. In addition, IDEA 2004 required states to establish performance goals for students 
with disabilities that are consistent with the state’s definition of AYP under NCLB and to report 
annually on progress toward meeting these performance goals. 

NCEO has documented the public reporting of state participation and performance information 
for student with disabilities since 1997. The first NCEO report found that most states did not 
publicly report information on either participation or performance for students with disabilities 
and that many students with IEPs were exempted from testing altogether (Thurlow, Langenfeld, 
Nelson, Shin, & Coleman, 1998). The NCEO reports covering the time span from 1998-2002 
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showed that states slowly made improvements in their reporting practices for students with 
disabilities, specifically in disaggregation of the participation and performance results of these 
students on state assessments (Bielinski, Thurlow, Callender, & Bolt, 2001; Thurlow, House, 
Boys, Scott, & Ysseldyke, 2000; Thurlow et al., 1998; Thurlow, Nelson, Teelucksingh, & Ys- 
seldyke, 2000; Thurlow, Wiley, & Bielinski, 2003; Ysseldyke, Thurlow, Langenfeld, Nelson, 
Teelucksingh, & Seyfarth, 1998). 

The purpose of this report is to document the participation and performance trends over time for 
students with disabilities, progressing from school year 2001-02, a base year for determining 
AYP goals under NCLB, through school year 2004-05, the third year that states reported after 
the NCLB baseline year (VanGetson & Thurlow, 2007). Within this time frame NCEO prepared 
yearly reports to track public reporting of state assessment results (Klein, Wiley, & Thurlow, 
2006; Thurlow & Wiley, 2004; VanGetson & Thurlow, 2007; Wiley, Thurlow, & Klein, 2005). 
This report is a compilation of state data across this time frame and focuses on the extent to 
which states reported participation and performance data, and an analysis of the participation and 
performance trends for those states reporting data. The goals of this synthesis of findings were to 
determine: (1) whether progress has been made by states in publicly reporting the participation 
and performance of students with disabilities on state assessments, and (2) the nature of trends 
in the four years of participation and performance data for students with disabilities. 



Methods 

Data were gathered from previous NCEO reports on state assessment reporting for school years 
2001-02 through 2004-05 (Klein et al., 2006; Thurlow & Wiley, 2004; VanGetson & Thurlow, 
2007; Wiley et al., 2005). Data points were obtained from reports and inserted into data tables 
showing participation and performance for each state, by year, for each grade level and content 
area. 

The original data for these reports were gathered from individual state department of education 
Web sites, with collection generally starting during the winter following a spring-fall assessment 
cycle. The test name, grade levels assessed, content areas tested, test type, and availability of 
disaggregated participation and performance data for students with disabilities were recorded 
for each report. NCEO staff also documented whether participation and performance data were 
reported each year for students with disabilities. Typically this information was available online 
for slightly more than half of the states by mid- winter. Each year, these publicly-reported data 
were combined with data points obtained by NCEO during a springtime verification process 
with state directors of assessment and state directors of special education in order to generate 
the database of state information for past reports. 
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Because states were not required to report for each grade in the span of grades 3-8 until 2005- 
06, many of the states in this report had data for only one or two grades within the elementary, 
middle, and high school levels. The appendix shows the grades for which states reported in 
each year, as well as the grade level of data we used for our trends analysis. Consistent with 
our previous reports on public reporting of participation and performance, we used grades 4, 
8, and 10 if available. When these grades were not available we used another specified grade 
for the school level. 

Trends in participation and performance could only be analyzed for those states that reported 
data. In order to maximize the data available for these analyses, a search of current state educa- 
tion Web sites was conducted to find historical assessment data posted after our initial analysis 
and reports, but now available to the public. Our initial analyses of participation data left only 
two states with historical participation information going back four years (Connecticut, Kansas). 
New participation information was uncovered for the other seven states included in this report 
(Colorado, Iowa, Nebraska, North Carolina, North Dakota, Washington, Wisconsin), enabling 
our analysis to include four years worth of information for a total of nine states. 

New performance data points from states with available data across four consecutive years were 
added to the analysis as long as they met the specific guidelines we had used previously for 
clarity and depth in reporting. These efforts accounted for the inclusion, for both reading and 
math, of two states at the elementary and middle school level, and four states at the high school 
level: Iowa — elementary, middle, and high school; Kentucky — high school; Montana — elemen- 
tary, middle, and high school; Mississippi — high school. Similarly, data points that had been 
revised for presentation on the Web site were accepted as replacements for data points obtained 
from NCEO report appendices or from raw data points that were the basis for NCEO figures in 
earlier reports. Such revisions occurred infrequently, for only one state at the elementary and 
middle school levels, and for three states at the high school level, for both reading and math 
(Connecticut — elementary, middle, and high school; New Mexico — high school; New Jersey- 
high school). 

Though alternate assessment participation and performance information was collected in general 
terms starting in 2001-02, it was not included state by state in previous analyses of the public 
reporting of state assessment results for students with disabilities. Thus, the collection of these 
data was an entirely new undertaking and all information included in this section is new. 

Data for this report were analyzed only for criterion-referenced assessments. The public pre- 
sentation of assessment information for these assessments, disaggregated for students with 
disabilities, was considered to be clear only if it met specific guidelines. First, the data must 
have been presented by states in percentages and not just raw numbers of students — ideally 
with underlying numbers clearly evident — and must have been disaggregated for “students with 
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disabilities,” “students with IEPs,” or “special education students.” Second, data must have been 
disaggregated by grade level and content area. Third, the assessment must have been clearly 
designated as either a regular assessment (given to most students) or an alternate assessment 
(given to a smaller number of students). All data and documents were verified by NCEO staff 
prior to analysis. Trend work began in the fall of 2006. 

Results 

Characteristics of State Regular Assessments 

Table 1 shows the total number of regular assessments across states, the number of states with 
more than one assessment, the number of criterion referenced tests (CRTs), and the percentage 
of assessments that are CRTs in each year from 2001-02 through 2004-05. Since 2001-02, the 
number of different regular assessments (n=107-l 12), and the number of states with multiple 
regular assessments (n=35), have stayed relatively constant. There has been a trend toward a 
higher number and percentage of tests that are criterion-referenced tests (CRT), while the ma- 
jority of remaining assessments are norm-referenced tests (NRT), assessments where students’ 
scores are compared against the norms of a defined population. 

Table 1. Overview of States’ Regular Assessments 



Year 


Number 
of Regular 
Assessments 


Number of 
States with 
More than One 
Assessment 


Number of 
CRTs 


Percentage of 
Assessments 
That Are CRTs 


2001-02 


111 


35 


64 


58% 


2002-03 


110 


35 


70 


64% 


2003-04 


112 


35 


76 


68% 


2004-05 


107 


35 


75 


70% 



Quality of Assessment Reporting for Students with Disabilities 

Regular Assessment 

Table 2 shows the extent to which assessment information was disaggregated for students with 
disabilities on regular assessments from 2001-02 through 2004-05. The percentages were rela- 
tively stable across the four years. 



4 



NCEO 



Table 2. Disaggregated Data for Students with Disabilities on Regular Assessments 



Year 


Total Number 
Assessments 


Participation 


Performance 


Number of 
Assessments 


Percent 1 


Number of 
Assessments 


Percent 1 


2001-02 


111 


91 


82% 


98 


88% 


2002-03 


110 


89 


81% 


91 


83% 


2003-04 


112 


94 


84% 


97 


87% 


2004-05 


107 


84 


79% 


94 


88% 



1 Percent is derived by dividing number of assessments reported by total number of assessments. 



Table 3 shows the reporting practices for participation and performance by states rather than 
by assessments. When viewed this way, there does appear to be variation in reporting practices 
among states. In 2004-05, all but two states provided participation and performance data for at 
least some of their state assessments, and every state provided some assessment performance 
data disaggregated for students with disabilities. This was the first time in the past four years 
that every state reported disaggregated data. The number of states reporting participation and 
performance data for all of their regular assessments has remained relatively unchanged during 
the past four years. 



Table 3. Numbers of States Disaggregating Regular Assessment Data for Students with 
Disabilities 



Year 


Participation & 
Performance 
for All State 
Assessments 


Performance 
Only for All State 
Assessments 


Participation & 
Performance 
for SOME State 
Assessments 


No Participation 
or Performance 


2001-02 


35 


4 


9 


2 


2002-03 


36 


1 


10 


3 


2003-04 


35 


2 


11 


2 


2004-05 


36 


2 


12 


0 



Table 4 provides more detailed information about participation in assessments, with percent- 
ages based on the total number of assessments given by the states. States increasingly seem to 
be reporting certain types of information, including the percentage of students with disabilities 
tested, and the number and percentage of students not tested for various reasons on statewide 
assessments. For example, there was an increase of 27 percentage points from 2001-02 to 
2004-05 for the number of assessments for which “percent of students tested” was reported. 
Similarly, there was a 17 percentage point increase in the reporting of the number “not tested” 
and a 15 percentage point increase in the reporting of the percentage “not tested.” Other types of 
information remained relatively stable, including the percent exempted/excluded (1 percentage 
point increase), and the number tested, which was reported most often. 
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Table 4. Details of Participation Reporting for Regular Assessments 



Year 


Total 

Number of 
Assessments 


Participation Information Reported Publicly (percent of assessments) 1 


Number 

Tested 


Number Not 
Tested 


Percent 

Tested 


Percent 

Not 

Tested 


Number 

or 

Percent 

Absent 


Percent 
Exempt or 
Excluded 


2001-02 


111 


68% 


3% 


20% 


13% 


5% 


7% 


2002-03 


110 


67% 


7% 


31% 


12% 


13% 


6% 


2003-04 


112 


71% 


16% 


44% 


27% 


17% 


4% 


2004-05 


107 


68% 


20% 


47% 


28% 


17% 


8% 



The denominator used to calculate percentages for this table was total number of assessments, not total number of states. 



Alternate Assessment 

Table 5 shows the number and percentage of states that reported participation and performance 
data for state alternate assessments for each year from 2001-02 through 2004-05. Steady in- 
creases were evident across time for the reporting of both participation and performance, with 
a 19 state increase in the number of states reporting participation, and a 17 state increase in the 
number of states reporting performance. 



Table 5. Data Reported for Students with Disabilities on Alternate Assessments 



Year 


Participation 


Performance 


States Reporting 


Percent 1 


States Reporting 


Percent 1 


2001-02 


27 


54% 


27 


54% 


2002-03 


32 


64% 


33 


66% 


2003-04 


35 


70% 


34 


68% 


2004-05 


46 


92% 


44 


88% 



1 The denominator used to calculate percentages for this table was total number of states, not total number of 
assessments. 



Table 6 provides another view of information on state reporting of alternate assessment data. 
This table shows that from 2001-02 through 2004-05, 15 additional states began reporting partial 
information (either participation or performance), and 21 additional states began reporting both 
participation and performance information. By 2004-05, 43 states provided both participation 
and performance data, and all but three states reported some information about participation 
and performance for students with disabilities on alternate assessments. 
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Table 6. Details of States’ Disaggregated Alternate Assessment Data for Students with 
Disabilities 





Number of States Reporting 


Year 


Participation & 
Performance 


Participation Only 


Performance Only 


Did Not Report 


2001-02 


22 


5 


5 


18 




29 


3 


4 


14 




33 


2 


1 


14 




43 


3 


1 


3 



Table 7 provides information on the details of participation reporting for alternate assessments, 
such as the number and percentage of students tested, not tested, and exempted/excluded, or 
absent. The percentages in Table 7 are based on the total number of alternate assessments re- 
ported by states. There is evidence of a general trend toward more states performing calculations 
and reporting the percent of students tested (gain of 48 percentage points) and not tested. In 
2001-02, no state reported information on students who were exempt or absent for the alternate 
assessment. By the 2004-05 school year, 8% of state assessments reflected exempt or excluded 
students and 12% reflected the number or percent of students absent. 



Table 7. Details of Participation Reporting for Alternate Assessments 



Year 


Total 

Number of 
Assessments 


Participation Information Reported Publicly (percent of assessments) 1 


Number 

Tested 


Number 

Not 

Tested 


Percent 

Tested 


Percent 

Not 

Tested 


Percent 
Exempt or 
Excluded 


Number 

or 

Percent 

Absent 


2001-02 


50 


44% 


4% 


18% 


6% 


0% 


0% 


2002-03 


51 


59% 


8% 


29% 


4% 


6% 


2% 


2003-04 


52 


63% 


12% 


38% 


17% 


12% 


4% 


2004-05 


59 


78% 


27% 


66% 


32% 


8% 


12% 



The denominator used to calculate percentages for this table was total number of assessments, not total 
number of states. 



Figure 1 shows the number of states that reported some level of performance data for students 
with disabilities for at least one alternate assessment. In 2004-05, there was a substantial increase 
over previous years in the number of states providing these data. 
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Figure 1 . Trends in Reporting for Performance on Alternate Assessments. 
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Student Participation and Performance on Regular Reading and Math Assessments 
Participation in Regular Assessments 

For this and all other sections of this report, participation rates that were publicly reported for 
reading and math assessments at the elementary, middle, and high school levels were summa- 
rized for the years 2001-02 through 2004-05. Each school level (elementary, middle, and high 
school) was represented by one grade per state, typically grades 4, 8, and 10. If data for any of 
these grades were unavailable, that school level is represented by grade 5, 7, or 11, depending 
on school level. Data were used by one state each for grades 3, 6, and 12 due to a lack of data 
for other grades in the school level. Complete data were available for only eight states for read- 
ing and nine states for math. Only these states provided clear reporting of both numerator and 
denominator numbers across the four years. 

Elementary Reading - Regular Assessments. Figure 2 presents the participation rates for 
the regular reading assessments in elementary school from 2001-02 through 2004-05 for eight 
states. In 2001-02, these states had an average participation rate of 90%, but this figure was due 
to rather low values for two states (Connecticut and North Carolina); the median participation 
rate was 96%. All eight states tended to show either increases in their rates or ceiling effects 
across the four-year reporting period, with a mean of 96% and a median of 98% in 2004-05. 
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Figure 2. Participation Rates for Students with Disabilities on Elementary Reading 
Assessments 
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Middle School Reading - Regular Assessments. Figure 3 presents participation rate data for 
students with disabilities on regular reading assessments in middle school from 2001-02 through 
2004-05 for the eight states with data. Positive trends are evident in the mean participation 
rate (89% to 96%), and in the median rate (95% to 97%) over the four years. These gains were 
largely accounted for by two states (Connecticut and North Carolina) due to their relatively 
lower initial rates. 



Figure 3. Participation Rates for Students with Disabilities on Middle School Reading 
Assessments 
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High School Reading - Regular Assessments. Figure 4 presents participation rate data for 
students with disabilities on regular assessments in high school for 2001-02 through 2004-05 for 
the eight states. Mean participation rates increased from 87% to 94% from school year 2001-02 
to 2004-05, and median rates rose from 88% to 96% in the same years. 

Figure 4. Participation Rates for Students with Disabilities on High School Reading 
Assessments 
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Elementary Math - Regular Assessments. Figure 5 shows the nine states reporting mathemat- 
ics participation data from 2001-02 through 2004-05; these were the same states that reported 
reading participation data, along with Nebraska. Participation rates for students with disabilities 
in these states on elementary math assessments from 2001-02 through 2004-05 were relatively 
stable, except in two states. Connecticut and North Carolina reported lower initial rates in 2001- 
02, and these states showed the largest absolute gains by 2004-05. Across all nine states, mean 
rates increased from 92% to 97%, and median scores increased from 96% to 99%. 

Figure 5. Participation Rates for Students with Disabilities on Elementary Math Assessments 



100% 

90% 

_ 80% 
® 70% 

v> 60% 
® 50% 

£ 40% 

• 30% 

£ 20 % 
Q- 10% 
0% 




CO CT IA KS NC ND NE WA Wl 

State 

□ 2001-2002 □ 2002-2003 @2003-2004 B 2004-2005 



10 



NCEO 





Middle School Math - Regular Assessments. Figure 6 shows the nine states that reported 
mathematics participation data from 2001-02 through 2004-05. Participation rates for middle 
school were relatively stable over the period investigated (except in Connecticut and North 
Carolina), with the mean increasing from 89% in 2001-02 to 96% in 2004-05. The median 
increased from 92% to 98%. 

Figure 6. Participation Rates for Students with Disabilities on Middle School Math 
Assessments 
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High School Math - Regular Assessments. Figure 7 shows the nine states that reported math- 
ematics participation data from 2001-02 through 2004-05 . Across the four years, the participation 
rate for high school showed a mean gain of nine percentage points, rising from 85% to 94%. 
Four states reported relatively large increases in participation, thus producing an increase in 
the median from 85% to 97%. 

Figure 7. Participation Rates for Students with Disabilities on High School Math Assessments 
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Performance on Regular Assessments 



Trends in the percent of students attaining proficient or above performance levels on their state 
assessments are displayed for the content areas of reading and math by school level; data were 
available for a total of 32 states. Nineteen states provided data for at least one grade within 
Elementary (3-5), Middle School (6-8), and High School (9-12). In addition, eight states provided 
elementary and middle school data, but not high school data: California, Louisiana, Maryland, 
Michigan, North Carolina, New York, Texas, and Virginia; four states provided high school data 
only: Alabama, New Hampshire, New Mexico, South Carolina; and one state provided elemen- 
tary and high school data, but no data for middle school: Nevada. To view data from the largest 
numbers of states possible, we allowed the number of states to differ for each school level and 
content area. States varied in the denominator used to calculate percent of students proficient. 

Elementary Reading - Regular Assessments. Performance data were available for 28 states 
for elementary reading; these data are shown in Figure 8 in terms of the percentage change in 
students who are proficient or above from 2001-02 through 2004-05. During this period, the 
average percent of students proficient for these states increased seven percentage points. For 
the four-year span, Kansas, Louisiana, Maryland, and Michigan all saw improvements of more 
than 20 percentage points in the number of students with disabilities achieving proficiency on 
the state’s regular assessment. Eight states showed decreases, including Texas with the larg- 
est decrease (from 89% in 2001-02 to 69% in 2004-05), and Massachusetts with the smallest 
decrease (from 19% in 2001-02 to 18% in 2004-05). The median change for all states was an 
increase of six percentage points across the four-year span. 



12 



NCEO 





Percent Change 2001-02 • 2004-05 



Figure 8. Performance Trends for Students with Disabilities on Elementary Reading 
Assessments 
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Middle School Reading - Regular Assessment. Performance data were available for 27 states 
for middle school reading; these data are shown in Figure 9. The average proficiency rate of 25% 
in 2001-02 increased to 29% by 2004-05. Maryland saw an increase of 23 percentage points 
in the percentage of students with disabilities attaining proficient or above on the state assess- 
ment. Across the time span, five states saw decreases. Texas showed a large decrease, from 85% 
to 61%; Alaska, Connecticut, Montana, and North Carolina all showed smaller decreases in 
the percentage of students with disabilities proficient or above. The median change in percent 
proficient across the four-year period was an increase of four percentage points. 

Figure 9. Performance Trends for Students with Disabilities on Middle School Reading 
Assessments 
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High School Reading - Regular Assessments. Performance data were available for 24 states 
for high school reading; these data are shown in Figure 10. The average rate of proficiency rose 
one percentage point for these states between 2001-02 and 2004-05. New Jersey had an increase 
of 27 percentage points in the percentage of students with disabilities achieving proficient or 
above levels on the state’s regular assessment. Nine states showed decreases, including New 
Mexico, with the largest decrease in the percentage of students proficient (38 percentage points 
decrease between 2001-02 and 2004-05), and eight other states with smaller decreases in the 
percent proficient across the four-year span. The median gain for all states across the four-year 
span was three percentage points. 

Figure 10. Performance Trends for Students with Disabilities on High School Reading 
Assessments 
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Elementary Math - Regular Assessments. Performance data were available for 28 states 
for elementary math; these data are shown in Figure 11. During the four years studied, the 
average rate of students proficient or above increased eight percentage points. The percentage 
of students with disabilities who were proficient or above increased more than 20 percentage 
points in Arizona, Kansas, Louisiana, and Maryland. Nine states had decreases across the same 
period, ranging from 18 percentage points in Texas and 17 percentage points in North Carolina, 
to single digit drops in seven other states. The median change across all states was an increase 
of 10 percentage points for the four-year span. 

Figure 11. Performance Trends for Students with Disabilities on Elementary Math 
Assessments 
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Middle School Math - Regular Assessments. Performance data were available for 27 states for 
middle school math; these data are shown in Figure 12. The average rate of students proficient 
increased from 18% in 2001-02 to 22% in 2004-05. Wisconsin showed an increase of 21 percent- 
age points while 22 other states saw gains of lesser amounts. Four states showed decreases in 
the percentage of students with disabilities who were proficient or above, including Texas with 
the largest decrease (50 percentage points) and Ohio with a medium decrease (13 percentage 
points), to single digit decreases in two other states. The median gain across the four-year span 
was four percentage points. 

Figure 12. Performance Trends for Students with Disabilities on Middle School Math 
Assessments 
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High School Math - Regular Assessments. Performance data were available for 24 states for 
high school math; these data are shown in Figure 13. In 2001-02 the 24 states had an average 
rate of 23% of students with disabilities who were proficient and above; that rate was 22% in 
2004-05. New Jersey showed the largest increase in percentage (24 percentage points) and 
was the only state to show an increase of more than 20 percentage points. Three states showed 
declines of more than 20 percentage points during this period (New Mexico, Ohio, and South 
Carolina), and seven others showed lesser declines in the percent of students proficient or above. 
Overall, the median change was an increase of one percentage point across all states for the 
four-year period. 

Figure 13. Performance Trends for Students with Disabilities on High School Math 
Assessments 
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Student Participation and Performance on Alternate Reading and Math Assessments 



Participation on Alternate Assessments 

Trends in alternate assessment participation are unclear because state data have only recently 
begun to be reported publicly on a consistent basis. When the data are reported, they often are 
reported only as reading and math overall totals, and not disaggregated by school levels. For 
example, in 2001-02, 13 states gave a rate of either the percent of students tested or the per- 
cent not tested in their alternate assessment. However, the denominator used to arrive at this 
information varied dramatically. Some states reported an overall percentage of students with 
disabilities who took the alternate (e.g., 10%) whereas other states gave the percentage of all 
students tested in the alternate (e.g., 1%). Still others gave the percentage of students tested out 
of the total eligible for the alternate (e.g., 97%). Some states disaggregated participation rates 
by grade level or content area while others gave an overall rate. By 2004-05, 38 states provided 
a percentage of either students tested or not tested. However, not all of these states reported 
the data clearly for each grade and content area, either aggregating across grade or content, or 
presenting the percent of all students tested, or the percent of students out of the total eligible 
for the alternate assessment. 

There were two states that reported participation using the total number of students with dis- 
abilities as the denominator as far back as 2002-03 (year two of this analysis) and also in 
2004-05. These states showed little or no change across years (Wisconsin: 7% increased to 
8%; North Carolina: no change). Three states reported participation using the total number of 
enrolled students as the denominator (which leads to small percentages) in both 2002-03 and 
2003-04. None of these three states reported in the same way for 2004-05. Massachusetts and 
New Hampshire reported small changes from 2002-03 to 2003-04, and Washington reported a 
decrease from 3.6% to 0.7%. 

Performance on Alternate Assessments 

Trends in alternate assessment performance across states are displayed for the content areas of 
reading and math by school level. These data were reported with more depth and clarity between 
2001-02 and 2004-05 than were participation data for the alternate assessment. Nevertheless, 
the number of states with these data also was small. In an effort to increase the number of states 
in each analysis, data were included from any state that had data for at least three of the four 
years. In all cases, the percent of students proficient shown are the number proficient divided 
by the number of alternate assessments taken. 

Elementary Reading - Alternate Assessments. Performance data were available for eight 
states for elementary reading; these data are shown in Figure 14. The average percent of students 
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proficient and above increased 22 percentage points from 2001-02 through 2004-05. During this 
time, Alaska, Delaware, New York, and Washington all had increases of more than 30 percentage 
points for students with disabilities who were proficient or above on the alternate assessment. 
Two states had slight decreases: Colorado and Texas. 

Figure 14. Performance Trends for Students with Disabilities on Elementary Reading Alternate 
Assessments 
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Middle School Reading - Alternate Assessments. Performance data were available for eight 
states for middle school reading; these data are shown in Figure 15. In 2001-02 the average 
percent proficient was 49%. This increased to 70% by 2004-05. During this time, the percentage 
of students with disabilities who were proficient or above on the alternate assessment increased 
by more than 30 percentage points in Alaska, New York, and Washington. Two states, Arizona 
and Texas, saw decreases in the percentage of students who were proficient on the alternate 
assessment. 



Figure 15. Performance Trends for Students with Disabilities on Middle School Reading 
Alternate Assessments 
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High School Reading - Alternate Assessments. Performance data were available for six states 
for high school reading; these data are shown in Figure 16. The average percent proficient 
of 33% in 2001-02 increased to 65% in 2004-05. Alaska, Delaware, and Washington all saw 
improvements of 35 percentage points or more. Two states, Arizona and Colorado, saw slight 
decreases from 2001-02 to 2004-05 in the percentage of students with disabilities who were 
proficient on the alternate assessment. 

Figure 16. Performance Trends for Students with Disabilities on High School Reading 
Alternate Assessments 
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Elementary Math - Alternate Assessments. Performance data were available for eight states 
for elementary math; these data are shown in Figure 17. The average percent proficient rate 
increased 24 percentage points between 2001-02 and 2004-05. An increase of 12 percentage 
points occurred between 2002-03 and 2003-04. The average percentage of students with dis- 
abilities proficient or above increased by more than 30 percentage points in Alaska, New York, 
and Washington. All states with data showed positive gains in the percentage of students profi- 
cient on the alternate assessment. 
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Figure 17. Performance Trends for Students with Disabilities on Elementary Math Alternate 
Assessments 




Middle School Math - Alternate Assessment. Performance data were available for eight states 
for middle school math; these data are shown in Figure 18. The 2001-02 average percent pro- 
ficient of 45% for students with disabilities increased to 67% by 2004-05. Alaska, New York, 
and Washington saw increases of more than 30 percentage points. Only one state, Arizona, saw 
a decrease during this time. 

Figure 18. Performance Trends for Students with Disabilities on Middle School Math Alternate 
Assessments 
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High School Math - Alternate Assessments. Performance data were available for six states 
for high school math; these data are shown in Figure 19. A 2001-02 average proficient rate of 
29% for students with disabilities on the alternate assessment increased to 59% by 2004-05. 
Five states showed gains, with the most dramatic being that shown by the state of Washing- 
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ton — from 4% of students with disabilities proficient in 2001-02 to 51% of students with dis- 
abilities proficient in 2004-05. 



Figure 19. Performance Trends for Students with Disabilities on High School Math Alternate 
Assessments 
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Discussion 

Publicly reported data on the participation and performance of students with disabilities provide 
important information about how well states are meeting their reporting responsibilities. Where 
states are reporting well, the public data reveal actual student participation and performance 
trends. In this report, we looked at the public reporting of state assessment participation and 
performance data over a four year time span — from 2001-02 through 2004-05. The start of this 
time period coincides with the 2001-02 baseline year for determining Adequate Yearly Progress 
(AYP) and the beginning of implementation of NCLB. The results reflect the NCLB mandate 
to assess all students, including IDEA-eligible and Section 504-eligible students, and to report 
not only schoolwide results for AYP calculations, but also to report disaggregated assessment 
data for subgroups, one of which is students with disabilities. 

The time frame of this report also covers the beginning implementation of the 2004 IDEA 
reauthorization. IDEA 2004 reinforced IDEA 1997, which for the first time in a special educa- 
tion law required state education agencies to report participation and performance results for 
students with disabilities with the same frequency and detail as for students without disabilities. 
By studying trends over these years, we looked for: (1) whether progress has been made by 
states in publicly reporting the data of students with disabilities on state assessments, and (2) 
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whether trends existed in the four years of participation and performance data for students with 
disabilities. 

Given the increasing emphasis on public reporting, it is not surprising to find that more states 
reported more of the data required in 2004-05, the last year of analysis, than in the initial years. 
It is disappointing, nevertheless, to find that the number of states for which data were available 
across the four years was relatively small. For the regular assessment, only slightly over half 
had performance data across this time period, and fewer than 10 states had participation data 
for each of the four years studied. Even with a more lenient approach to looking at alternate 
assessment data (i.e., including a state if it had at least three years of data), only eight states 
reported performance data for the alternate assessment across the time period, and no states 
reported participation data in a consistent manner across each of the four years (though three- 
year trend data starting in 2002-03 were available for two states). 

Discrepancies between the numbers of states reporting performance data and the numbers 
reporting participation data for both the regular assessment and the alternate assessment are 
worrisome. Performance data have little meaning if we do not know the number and percentage 
of students included in the data on which performance results are based. Furthermore, the find- 
ing that the gap between the reporting of proficiency data and participation data on the regular 
assessment narrowed and then increased again, with gaps going from 6% to 2% to 3% to 9%, 
begs explanation. It is unclear whether the differences in reporting are related to accountabil- 
ity requirements or can be explained in some other way — such as changing data management 
systems making it difficult to retrieve participation data for a year or two. 

Trends in the Public Reporting of Assessment Data 

When we examined reporting year by year, we found considerable evidence of improvements 
in reporting. For example, 48 states reported at least some disaggregated results for regular as- 
sessments of students with disabilities in school year 2001-02. By 2004-05 all 50 states included 
at least some disaggregated data in their reporting. While this trend seems positive, it reflects a 
global look at reporting, counting states even if they report only part of what should be reported. 
The number of states reporting disaggregated participation and performance data for all of their 
regular state assessments was only 36 states (72%) in 2004-05. This number of states was only 
one more than the lowest number of states during the four year period. Over one quarter of the 
states (14 states - 28%) did not publicly report assessment data for students with disabilities 
for all their regular assessments in 2004-05. 



24 



NCEO 





Greater increases in number of states reporting were found for alternate assessments. In 2001-02 
only 32 states reported any alternate assessment data (either participation or performance, or 
both). This increased to 47 states (94%) by 2004-05. Thurlow and Wiley (2004) suggested that 
the low number of states reporting alternate assessment data in 2001-02, in comparison to the 
number reporting regular assessment data (n=48 states), might have been partly attributable to 
the longer time needed to develop state alternate assessments and meet reporting requirements. 
Although the increases in reporting may support this hypothesis, it does not explain why states 
reporting alternate assessment results did not also report regular assessment results. 

The level of detail in which states reported participation data for each of their regular assess- 
ments increased across the four years studied. Reporting of the percent of students tested and the 
percent of students not tested showed an increase of more than 15 percentage points, based on 
all of the regular assessments administered. Still, for less than half of the 2004-05 assessments 
was percent of students tested reported, and for less than one-third was percent of students not 
tested reported. It was less likely still that percent exempt/excluded and percent absent were 
reported for an assessment. These low rates of reporting occurred despite the fact that the num- 
ber of students tested was reported for 68% of the assessments. Similar discrepancies and low 
rates of reporting were observed for details about alternate assessment participation, although 
the percentage for which details were provided was sometimes higher than for the regular as- 
sessment. 

Trends in Participation and Performance 

Analyses of trends in actual student participation or performance are dependent on the data 
available. In this study we looked at four years of data, from 2001-02 through 2004-05. Despite 
relatively high year-to-year rates of reporting, with the rates generally increasing each year, the 
data available for examining participation and performance trends were limited. Performance 
data met our criteria more often than participation data, a finding that should raise concerns. To 
really understand performance results, it is necessary to have a good understanding of participa- 
tion rates, including the details surrounding those rates. 

Even though there were limited numbers of states with data available across the years 2001-02 
through 2004-05, we did examine data available from those states. In doing so, we recognize 
the limited scope of these analyses. For instance, those states that reported publicly might be 
the states in which students are doing better in terms of either participation or performance, and 
so relying on these data for a picture of trends may overestimate participation or performance 
across the country or otherwise misidentify trends. 
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The fact that a state is included here is positive — it indicates that the state has consistently re- 
ported data disaggregated for students with disabilities across years. Unfortunately, only eight 
states did so for participation in regular reading assessments, and only nine states did so for 
participation in regular math assessments. For those states that reported, participation rates for 
the regular assessment were relatively stable across years, and the median rates for all school 
levels were above 95 percent by the 2004-05 school year. This value is notable because it cor- 
responds to the NCLB accountability criterion that for a school to be considered to have met 
AYP requirements it must have a participation rate of at least 95% overall for each subgroup. 
In the end, the inferences that can be drawn about trends in the regular assessment participation 
of students with disabilities are limited by the small number of states with these data. 

Trends in regular assessment performance may be easier to gauge based on the data publicly 
reported by states. Many more states reported performance data than had reported participation 
data, and this difference is magnified when looking at data across years. Data were available 
for between 24 and 28 states, depending on the school level (elementary, middle, high school) 
and the content area. Nineteen states reported data for all of the content and school levels that 
we examined. Based on the states with data across years, average percentages of students with 
disabilities performing at the proficient or above level showed moderate increases across the 
four years for both reading and math in elementary and middle schools. Performance data for 
high school students did not show the same kinds of gains. This may be associated with increas- 
ing participation rates since the last students to be included in assessment may have been the 
lowest performing. 

Trends in performance showed more variability from year to year than participation. Several 
states reported increases in the percentage of students proficient and above, with as much as 
30 percentage point changes over four years. At the same time, several other states showed 
marked drops in the percentage of students proficient and above, including a drop as high as 50 
percentage points (middle school math in Texas) and 38 percentage points (high school reading 
in New Mexico). These types of large shifts may reflect a variety of factors, such as changes 
in the assessment system or curricular and instructional improvements, and further complicate 
inferences about trends over time in performance. 

Alternate assessment participation data could not be analyzed for trends because the methods 
of calculation and consistency in reporting do not reach back to the first year covered in this 
report. It is our hope that a similar analysis completed in the future could uncover changes in 
student participation in alternate assessment systems, especially in relation to the recent changes 
in guidance and policy surrounding these assessments. 

Alternate assessment performance data were available from only six states at the high school 
level and eight states at the elementary and middle school level, even when analysis criteria 
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were relaxed to require data from only three years. The percentage of students performing at a 
proficient or above level on states’ alternate assessments was generally higher than it was for 
students with disabilities on regular assessments, and gains tended to be larger across the four 
years, from 2001-02 through 2004-05. The discrepancy between regular assessment percentages 
and alternate assessment percentages, for example, 29% versus 70% proficient for middle school 
reading, raises the question of whether states have adopted somewhat less rigorous criteria for 
achieving proficiency on alternate assessments. Of course, these data — and thus, the questions 
that they raise — are limited by the small number of states with data sufficient for the current 
analysis. 

Conclusions 

It is vital to include the changing standards, assessments, policies, and practices within states as 
a reference point when one draws conclusions from a trends analysis such as this. Changes in 
participation guidelines within states lead to noticeable changes within the testing population, 
and for the states’ assessment performance overall. This is especially true for small subgroups 
such as students with disabilities. For example, in several states an increasing number of stu- 
dents are being tested on grade level content using the regular assessment, many of them using 
accommodations. It is quite possible that this new testing population includes a percentage of 
students who were previously assessed on below grade-level content standards or who were 
included in alternate assessments. Also, states that were among the first to approve an alternate 
assessment option for their students have recently begun to raise the bar on the expected content 
knowledge required to pass such assessments, which could result in uneven trends in student 
performance. 

Although the analyses of trends identifies some areas of increased reporting and better achieve- 
ment data, they also re-emphasize the need for states to publicly report data for educators, parents, 
and others to see. Further, our findings make evident the need for states to include all students 
with disabilities so that it is possible to look at the same data points across time. 

Results of analyses of 2005-06 school year data currently in process will provide some indication 
of whether the trends reported here have changed. These data should be particularly compre- 
hensive, since this period marks the first year that all states are testing all students in grades 3 
through 8, and once in high school, as required by NCLB. Continued investigations of not only 
trends but also the data available for examining trends is an important step for evaluations of 
the increases in participation and performance of students with disabilities over time. 
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Appendix 



Grade Levels Assessed by States in Years 2001-02 though 2004-05 (CRT 
assessments only) 

States did not necessarily report scores disaggregated by students with disabilities for these 
assessments in any or all of these years and may or may not be included in analyses contained 
in this report. 



State 


2001-02 


2002-03 


2003-04 


2004-05 


AK 


3*, 6, 8, 10 


3*, 6, 8, 10 


3-10 


3-10 


AL 


11*, 12 


12* 


4, 6, 8, 11* 


3-8, 11*, 12 


AR 


4, 6, 8, 9-12 


4, 6, 8, 9-12 


4, 6, 8, 9-12 


3-9, 11 


AZ 


3, 5*, 8, 10 


3, 5*, 8, 10 


3, 5*, 8, 10 


3-8, 10 


CA 


2-7*, 11 


2-11 


2-11 


2-11 


CO 


3-10 


3-10 


3-10 


3-10 


CT 


4, 6, 8, 10 


4, 6, 8, 10 


4, 6, 8, 10 


4, 6, 8, 10 


DE 


3, 5*, 8, 10 


2-11 


2-10 


2-10 


FL 


4, 5, 8, 10, 11 


3-11 


3-10 


3-10 


GA 


3-8, 11* 


1-8, 11* 


1-12 


1-12 


HI 


3, 5, 7, 9 


3, 5, 8, 10 


3, 5, 8, 10 


3-8, 10 


IA 


4, 8, 11* 


4, 8, 11* 


4, 8, 11* 


4, 8, 11* 


ID 


4, 8 (math only) 


K-10 


K-10 


K-10 


IL 


3, 5*, 8, 11* 


3, 5*, 8, 11* 


3, 5*, 8, 11* 


3, 5*, 8, 11* 


IN 


3, 6, 8, 10 


3, 6, 8, 10 


3, 6, 8, 10 


3-10 


KS 


4, 5, 7, 8, 10, 11 


4, 5, 7, 8, 10, 
11 


4, 5, 7, 8, 10, 11 


4, 5, 7, 8, 10, 
11 


KY 


4, 5, 7, 8, 10, 11 


4, 5, 7, 8, 10, 
11 


4, 5, 7, 8, 10, 11 


4, 5, 7, 8, 10, 
11 


LA 


2, 3, 4, 8, 10 


4, 8, 10, 11 


4, 8, 10, 11 


4, 8, 10, 11 


MA 


4, 6, 7, 8, 10 


3, 4, 6, 7, 8, 10 


3, 4, 6, 7, 8, 10 


3, 4, 6, 7, 8, 10 


MD 


3, 5*, 8, 9-12 


3, 5*, 8, 9-12 


3, 5*, 8, 9-12 


3-12 


ME 


4, 8, 11 


4, 8, 11 


4, 8, 11 


4, 8, 11 


Ml 


4, 7, 8, 11 


4, 7, 8 


4, 7, 8 


4, 7, 8 


MN 


3, 5, 8 


3, 5, 7, 8, 10, 
11 


3, 5, 7, 8, 10, 11 


3, 5, 7, 10, 11 


MO 


3, 4, 7, 8, 10, 11 


3, 4, 7, 8, 10, 
11 


3, 4, 7, 8, 10, 11 


3, 4, 7, 8, 10, 
11 


MS 


2-8, 11* 


2-8, 11* 


2-8, 11* 


2-12 


MT 


4, 8, 11* 


4, 8, 11* 


4, 8, 11* 


4, 8, 10 


NO 


3-12 


3-12 


3-12 


3-12 
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2001-02 

4, 8, 12* 

4, 8, 11* (math only) 

3, 6, 10 

4, 8, 11* 

3-10 

3, 4, 5, 8, 10-12 
4, 8, 9-12 
4, 6*, 9, 10 

5, 8, 11 

3, 5, 8, 10 
3, 5*, 8, 11* 

4, 8, 10 
3-8, 10 
NO CRT 

9-12 

3-12 

1-12 

3, 5*, 8, 9-12 

2, 4, 8, 10 

4, 7*, 10 

3, 4, 8, 10 
NO CRT 
4, 8, 11 



2002-03 


2003-04 


2004-05 


4, 8, 12* 


4, 8, 12* 


3-8, 11* 


4, 8, 11* 


4, 8, 11* (math only) 


4, 8, 11* 


3, 6, 10 


3, 6, 10 


3, 6, 10 


4, 8, 11* 


4, 8, 11* 


3, 4, 8, 11* 


3-10 


4, 8, 10 


3-9, 11* 


3, 5*, 8, 10 


3, 5*, 8, 11*, 12 


3, 5*, 8, 10, 11 


4, 8, 9-12 


4, 8, 9-12 


3-12 


4, 6*, 9, 10 


3, 4, 6*, 9, 10 


3-8, 10 


5, 8, 9-11 


5, 8, 9-11 


3, 4, 5, 8, 9-12 


3, 5, 8, 10 


3, 5, 8, 10 


3, 5, 8, 10 


3, 5*, 8, 11* 


3, 5*, 8, 11* 


3, 5*, 8, 11* 


4, 8, 10 


4, 8, 10 


K, 1, 11 


3-8, 10 


3-8, 10 


3-8, 10 


3-8, 11 


3-8, 11 


3-8, 11 


3-12 


9-12 


3-12 


3-12 


3-11 


3-11 


1-11 


1-11 


1-11 


3, 5*, 8, 9-12 


3, 5*, 8, 9-12 


3, 5*, 8, 9-12 


2, 4, 8, 10 


2, 4, 8, 10 


2, 4, 8, 10 


4, 7*, 10 


4, 7*, 10 


4, 7*, 10 


3, 4, 8, 10 


3, 4, 8, 10 


3, 4, 8, 10 


4, 7, 10 


3-8, 10 


3-8, 10 


4, 8, 11 


4, 8, 11 


4, 8, 11 



The grades with asterisks were used for analysis due to the lack of data for any of the targeted grades (4, 8, 10) 
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